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Abstract 

We consider a topological quiver matrix model which is expected to give a 
dual description of the instanton dynamics of topological U{N) gauge theory on 
D6 branes. The model is a higher dimensional analogue of the ADHM matrix 
model that leads to Nekrasov's partition function. The fixed points of the toric 
action on the moduli space are labeled by colored plane partitions. Assuming the 
localization theorem, we compute the partition function as an equivariant index. It 
turns out that the partition function does not depend on the vacuum expectation 
values of Higgs fields that break U{N) symmetry to U{1)^ at low energy. We 
conjecture a general formula of the partition function, which reduces to a power of 
the MacMahon function, if we impose the Calabi-Yau condition. For non Calabi- 
Yau case we prove the conjecture up to the third order in the instanton expansion. 



1 Introduction 



During the recent developments in the non-perturbative dynamics of supersymmetric 
gauge/string theories, we have witnessed many examples of the topological partition 
function which are exactly computable. They arise from the enumerative problems and 
are defined as the generating functions of instanton or BPS state counting. Thus they 
carry useful information for testing various dualities in supersymmetric theories, such 
as mirror symmetry, electro- magnetic duality and gauge/string correspondence. One of 
the important mathematical ideas in these computations is the equivariant localization 
theorem and it has revealed a close relation to the combinatorics. We use basic combi- 
natorial tools in representation theory, such as the partition (the Young diagram), the 
plane partition, the Schur function and the Macdonald function. For example, A^-tuple 
of the Young diagrams or the colored partition appears in Nekrasov's computation of 
Seiberg-Witten prepotential [H [21 [3] . We use the (skew) Schur function to write down 
the topological vertex [U [S] , which gives a building block of topological string amplitudes 
on toric Calabi-Yau threefolds. It is also related to the plane partition [B]. The generat- 
ing function of counting plane partitions is the MacMahon function, which is ubiquitous 
in topological gauge/string theory. For example, it appears in topological string ampli- 
tude on the conifold [7], the Gopakumar-Vafa invariants [H] and the Donaldson-Thomas 
theory [Ulinilll]- Finally the Macdonald function, which is the most general class of the 
symmetric functions, was employed to construct a refinement of the topological vertex 



It is quite interesting that the topological partition function often takes the plethystic 
form 3- Namely there exists a function J^{ti, t2,- ■ ■) and the partition function is written 
as the plethystic exponential; 



where we have denoted parameters of the theory collectively as {ti,t2, ■ ■ ■). This implies 
that the partition function has an infinite product (Euler product) form. Topological 
string amplitudes in the Gopakumar-Vafa form are basic examples. Furthermore the 

"'^The plethystic exponential also appears in the problem of counting gauge invariant operators in 
quiver gauge theories. See for example (TB]. 



[El [131 [a [15]. 





1 



fact that Nekrasov's partition function allows an expansion in the plethystic form is 
crucial to identify it as topological string amplitudes or their refined version [121 fT5] - 
The MacMahon function which is a basic partition function in the Donaldson-Thomas 
theory has also the plethystic form; 

oo / oo \ 

M(t):=TT(l-r)-" = exp V-^ —] . (1.2) 

It is an interesting challenge to uncover a possible mathematical and/or physical origin 
of the plethystic exponential in general. 

In this paper we consider a topological quiver matrix model which is expected to 
describe low energy and instanton dynamics of the topological gauge theory on D6 branes 
fUl [TBj . The model is a six dimensional analogue of the ADHM matrix model derived 
from low energy effective theory of DA-DO system [191 [201 [211 [22] . The instanton partition 
function for the ADHM matrix model is nothing but Nekrasov's partition function which 
is related to the Seiberg-Witten prepotential and topological string. The fixed points of 
the toric action on the moduli space of the ADHM matrix model are labeled by colored 
partitions [23J. Hence the localization theorem tells us that the partition function can 
be computed as a summation over colored partitions. We consider a similar instanton 
partition function for the six dimensional quiver matrix model. To compute the partition 
function based on the localization theorem, which we assume throughout the paper, we 
introduce action (2:1, 2:2, 2:3) {e^''^zi,e^''^Z2,e^''^z^) on C^, which may be regarded as 
the VL background of Nekrasov. We also consider the action of the maximal torus U{1)^ 
of the gauge group U{N), where the rank refers to the number of D6 branes. These 
toric actions induce the action on the moduli space of the topological quiver matrix model 
and the fixed points are labeled by A^-tuples of plane partitions (3d Young diagrams), or 
colored plane partitions [18]. The partition function is defined as an equivariant index 
and thus a rational function of equivariant parameters qi = e**^' from action and 

= e*"" from the maximal torus. Physically the vacuum expectation values of 

Higgs fields. We call the condition q := ^51^2^ = 1 Calabi-Yau condition, which can be 
compared with the anti-self-duality in four dimensions. When the Calabi-Yau condition 
is imposed, the weight or the measure at any fixed point is ±1 and consequently the 
partition function of U (N) theory reduces to the A^-th power of the MacMahon function. 
Hence the partition function is independent of both and Cq. 
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In non Calabi-Yau case the weight at each fixed point becomes rather comphcated 
expression and the partition function does depend on the equivariant parameters g^. 
However, we have found that even in this case, the instanton partition function is still 
independent of for lower instanton numbers. We believe this is quite surprising. 
Based on explicit computations for lower rank N and instanton number k, we propose 
the following formula of the topological partition function; 

ZT\<1^-^ A) = exp ^fj ^F^iql ql q",- A") j , (1.3) 



where 

A(l + q2 + q4 + . . . + q2A^-2) (1 - q,q,)(l - q,q,)(l - q,q,] 



(l-A)(l-q2^A) (l-gi)(l-g2)(l-g3) 



:i.4) 



and A := (— q)^^A is a renormalized parameter of the instanton expansion parameter A. 
Note that when q = 1, dependence of the partition function disappears completely and 
we have -Z'^ys^ = M(A)^. If we expand the first factor of in A, the coefficients are 
q-integers. Thus the above formula may have a certain interpretation of q-deformation. 

Mathematically the topological partition function we compute in this paper has a 
natural meaning in K theory. The K theoretic version of Nekrasov's partition function 
is physically regarded as a five dimensional lift and it is the K theoretic version which 
we can identity with topological string amplitudes. Thus we expect that our partition 
function has a seven dimensional interpretation, if we combine it with the perturbative 
contributions from Kaluza-Klein modes. In fact the partition function (II. 3p for abelian 



theory (A^ = 1) was conjectured in |24j together with a curious relation to M theory 
partition function. It is possible that the simplicity of the topological partition function 
we proposed above originates from the maximally supersymmetry of Yang-Mills gauge 
theory. In fact we have encountered before a similar example in five dimensional U{1) 
gauge theory with an adjoint hypermultiplet [Ul EH EZl- In this case Nekrasov's 
partition function takes the following form of the plethystic exponential; 



^5t(%Q;A) = E^'"n- 



exp 



. -a{s) e{s)+l . a{s)+l -e{s) 

A sex ^ HI H2 ^ Hi H2 

A" (l-g»g»)(l-Q»g^") | 

^nl-Q"A« (l-g^)(l-g2") J- 



The left hand side of (11.51) is a summation over partitions A. The integers a{s) and i{s) in 
the product are the arm length and the leg length that are defined by the corresponding 
Young diagram. The mass m of the adjoint hypermultiplet defines the parameter Q = 
g-m mass deformation. It is tempting to compare the parameter q in (II. 4p with 

Q in ([LSD. 

The topological quiver matrix model in this paper is a + 1-dimensional "world-line" 
theory on DO branes. However, we should emphasize that if the Donaldson-Thomas 
theory is formulated as a topological gauge theory on D6 branes, the effect of Z}2-branes 
on D6 cannot be negligible. If we want to regard the topological quiver matrix model as a 
dual description of the Donaldson-Thomas theory, it has to accommodate D2 branes. For 
example the contribution of "0-2" string should appear as a multiplicative factor to the 
partition function (11.31) . Recall that in [6J the enumeration of plane partitions led to the 
generating function Zx^^{u) = M{u)Cx^u{u), where three partitions (Young diagrams) 
X-i^iV define asymptotic conditions on plane partitions and u := e~^* is related to the 
string coupling Qg. The generating function is given by the topological vertex Cx^^{u) and 
the MacMahon function appears as a normalization factor. From this viewpoint what 
we have proposed above is an extension of the MacMahon factor to non Calabi-Yau case. 
Thus the issue is closely related to the problem of extending the topological vertex to 
toric Kahler threefolds. In any case incorporating the effect of D2 branes to the quiver 
matrix model is beyond the scope of the present paper. We want to address this issue in 
future. 

The paper is organized as follows; in section 2 we review the construction of topological 
quiver matrix model following [T71 [TS| . We clarify the relation of the stability 

condition and the vanishing theorem, which was not emphasized before in [T71 [IB] • In 
section 3 we introduce the toric action on the moduli space of the topological matrix 
model. The fixed points are isolated and they are classified by A^-tuples of plane partitions 
(colored plane partitions). Hence we can compute the partition function which is defined 
as an equivariant index by summing up the contribution at each colored plane partition. 
When the Calabi-Yau condition is imposed, the partition function reduces to a power of 
MacMahon function. Section 4 is the main part of the paper. We compute the partition 
function for non Calabi-Yau case and prove our conjecture (11.31) up to instanton number 
three. We first look at possible poles of the partition function in Cq and show that all 
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the residues vanish. Hence the partition function is independent of Co and we compute 
it by taking appropriate hmit (the decouphng hmit). It turns out that the identities 
among q-integers derived from the q binomial theorem reduce the conjecture for U (N) 
theory to that for f/(l) theory. We can check the conjecture for U{1) theory by direct 
computation. In Appendix A we give a brief review of the ADHM matrix model and the 
relation to Nekrasov's partition function. In Appendix B we check the well-definedness 
of our partition function. 



2 Topological quiver matrix model 

Let us consider a quiver matrix model for topological gauge theory on D6 brane pTl [18] . 
This is an analogue of the ADHM matrix model. As in the ADHM construction we 
introduce two vector spaces V and W of complex dimensions dime V = k and dime W = 
N. From the perspective of the gauge theory on the world volume of D6 brane, k is the 
number of DO branes (the instanton number) and is the number of D6 branes (the 
rank). The basic fields are the matrices 

Bi, B2,B^, if e Rom {V,V) , Ie}lom{W,V), (2.1) 

where {Bi, B2, B3,(f) come from "0-0" string and / comes from "6-0" string. Compared 
with the ADHM date for four dimensional gauge theory, the model does not have J G 
Hom (V, W), or "0-6" stringj. Instead, we have a matrix (f G Hom (V, V). This additional 
field comes from a reduction of a topological theory in eight dimensions [3T], which 
originates from the ten dimensional super Yang-Mills theory. We can show the vanishing 
theorem which implies that cp = on the moduli space [3I|. Hence, classically if is 
irrelevant to the moduli problem. However, the presence of is crucial for imposing the 
constraint (12.41) to be introduced below. We consider the following equations of motioijf 

£F:=[B,,B^] + ei,k[Blip]=0, (2.2) 
3 

^d(C) := J2^B,, Bj] + [if, ^t] + J/t _ ^ . 1^^^ = 0, (C > 0), (2.3) 

■t=i 

£^:=pcp = 0. (2.4) 



^See [3D] for an explanation from the viewpoint of T duality. 

■^See also [3111331 [31] on the equations of ADHM type for D0-D6 and D0-D8 systems. In these papers 
a background i3-field was introduced to obtain BPS bound states. 



5 



These are the gauge fixing conditions or the constraints in our topological matrix model 
with gauge symmetry U{k). Among them (12.21) gives three F-tern (holomorphic) con- 
ditions and (12. 3p is the (real) D-term condition which is responsible for the stability. 
There is no counter part of (12. 4p in the ADHM equation and it may be interesting to 
clarify its implication. Since describes the normal direction to the world volume of 
D6 branes, (12.41) means that the "6-0" string I is orthogonal to the normal direction 
[T7] . This implies that DO branes are forced to be bound to D6 branes. The reason why 
we should impose the constraint (12.41) might be related to the fact that D6-D0 system 
cannot make a BPS bound state without an appropriate fiux along the D6 branes |32j . 
In any case it is important to further clarify a possible explanation from the viewpoint 
of the BPS states. 

One can construct a topological matrix model following the prescription of [281 EH]- 
This was achieved in [T71 [18] . Since we have the constraints (12. 21) - (12. 4p . the moduli space 
of the topological theory is identified with 

-Mtqm := m, if, I)\Sf = SoiO =£b = Q}/U{k) . (2.5) 

Let us count the degrees of freedom. Since -Bj, if and / are complex matrices, there 
are 8/c^ + 2A^A; degrees of freedom. The constraints impose 6A;^ + A;^ + 2Nk relations. 
Finally we have U (k) gauge symmetry. Hence the formal dimension of the moduli space 
A^TQM vanishes. This is certainly due to the fact that the origin of our theory is the ten 
dimensional super Yang-Mills theory which is maximally supersymmetric. However, this 
gives us a puzzle, since we naively expect QNk degrees of freedom for k DO branes bound 
to DQ branes, which means the (complex) dimensions of the moduli space are 3Nk. 
We suspect the following fact is related to this issue. According to the general theory of 
topological matrix model [281 123 5 computing the Euler character of the anti-ghost 

bundle on the moduli space A^tqm- However, in the present case, the anti-ghost bundle 
only makes sense as a complex of bundles [T7] and it is in fact different from the tangent 
bundle of A^tqm which is defined by the linearization of the constraints. 

In the ADHM matrix model the moduli space of the type (12.50 comes from the 
hyperKahler quotient construction. It is well known that we have an equivalent definition 
of the moduli space by affine algebro-geometric quotient [21I23], where we omit the D-term 
condition but impose the stability condition on the orbits. We also have to complexify 
the gauge group to GL{k,C). Since it is not established at the moment that a similar 
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equivalence holds in our higher dimensional generalization, we assume it and we take 

Mtqm ■■= {{Bi, I) \Sf = Sb = 0, stability condition}//G'L(A;, C) , (2.6) 

as our definition of the moduli space in the following. In (12. 6p // means the affine algebro- 
geometric quotient where we only consider the orbits that satisfy the stability condition; 

There is no proper subspace S CV with BiS C S, lm(/) C 5* . (2.7) 

We now show that under the stability condition (12.71) we have a vanishing theorem that 
V9 = 0, if {Bi,{p,I) G A^TQM- Firstly, we note that the F-term condition £p = splits 
into two independent equations, 

[B,,B,] = [Bl^] = . (2.8) 

To see it, let := [bI, (^] E Hom (V, V). Then by f l2.2p and the Jacobi identity, we have 

Tr AlAk = ^e,,fcTr [ip^ , Bk] [B^, B,] = ie^.^Tr ip^[[B„ Bj], Bk] = . (2.9) 

Hence Ak = and (12.81) holds. To prove the vanishing theorem it is enough to show that 
if^v = for any v E V. By the stability condition the vector space V is generated by 
applying i?j's on lm(/). Hence any vector v E V can be written as f = Bi-^Bi^ ■ ■ ■ Bi^I{w) 
by choosing an appropriate vector w G W. Since and Bi's commute by (12.81) . (p'^v = 
Bi^Bi^ ■ ■ ■ Bi^(pH{w) = 0, where the last equality follows from Sb = 0. This completes 
the proof of the vanishing theorem. Consequently the matrix (p decouples and the moduli 
space is actually 

A^TQM = {{B„I) I [B^,Bj] = 0, stability condition}//GL(A;, C) . (2.10) 

Note that the matrix / only concerns the stability condition. 

It follows from (I2.10p that when = 1, we can identify A^tqm with the Hilbert 
scheme of k points in C^; 

Hilb'=(C=') = {IC C[zi, Z2, zs] I dim (C[2i, Z2, z^]/l) = k} , (2.11) 

where I denotes an ideal in the polynomial ring C[zi, Z2, z^]. We note that C[i?i, B2, -B3] — 
C[zi,Z2,Z3], since [Bi,Bj] = 0. For any ideal I G Hilb^'(<C^)> let V = C[zi, Z2, zs]/!. We 
define Bi G Hom (V", y) by the multiplication of Zi modulo X. When iV = 1, / is 
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defined by giving an element /(I) G V. We take /(I) = 1 modulo X. Then clearly 
[Bi, Bj] = and it is easy to see that the stability condition is satisfied. Conversely, for 
any element {Bi, I) G A^tqm, we define a map fi : C[zi, Z2, Z3] V hj Z2, Z3)) : = 

f{Bi, B2, -B3) • /(I), which is well-defined thanks to [B^, Bj] = 0. The stability condition 
implies that /i is surjective. Hence, if we define an ideal in C[zi, Z2, z^] by X := Ker fi, 
then C[zi, Z2, z^]/T ~ V. Since dime 1/ = fc, we have X G Hilb''(C3). 

We can write down the deformation complex associated with the moduli space (12.61) 
by the standard manner; 

©LiHom {V,V)k 

© ©3^.=iHom 
Yiom{y,V) ^ Hom(V,r) ^ © , (2.12) 

© Hom (\/, W) 

Hom {W, V) 

where the first term corresponds to the degrees of freedom of infinitesimal gauge trans- 
formation, the middle term parametrizes the tangent space of A^tqm and the last term 
comes from the linearization of the constraints 02.21] and fl2.4p . At a point G 
A^TQM the maps a and r are defined by 

:= 5^(5,, ^, /) = ([0, 5,], [0, y;], 0/), (2.13) 
r(((5fi„ 5^, 61)) := ([6B,, B,] + [5,, 6B^] + e,,k{[SBl ^] + [bI 6^]), + P6^^ . 

(2.14) 

Note that the gauge invariance of the constraints implies r o a = 0. 

3 Instanton partition function 

Generalizing the computation of Nekrasov's partition function as the topological partition 
function of the ADHM matrix model, which is reviewed in Appendix A, we want to com- 
pute the partition function of our quiver matrix model. By introducing the toric action 
on the moduli space and applying the localization theorem the partition function is com- 
puted as an equivariant index. We consider two toric actions on the moduli space A^tqm- 
The first one comes from the canonical action {zi, Z2, Z3) (e^^zi, 6**^^2:2, 6^^2:3) on C^, 
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which is an example of the f2 background of Nekrasov. The second one is induced from 
the action of the maximal torus U{1)^ of the global gauge group U{N). Physically the 
parameters ac, (a = 1, ■ ■ ■ , A^) of the maximal torus correspond to the vacuum expecta- 
tion values of the Higgs scalars or the distances of D6 branes. In the following we use the 
notations := e*"^', := e*"". Since we have GL[k, C) gauge symmetry, the condition of 
the fixed point is imposed up to gauge transformations. Hence, the conditions we have 
to solve are 

q,B, = g{q„ A) ■ B, ■ g-\qi, A) , (j = 1, 2, 3) (3.1) 
qmqs^ = 9{qi, A) ■ ■ g'^iQi, A) , (3.2) 
I-X = g{q,,X)-I , (3.3) 

where A G U{1)^. Note that at each fixed point the conditions fl3.1l) - fl3.3p define a 
homomorphism g : xU (1)^ GL{k, C) . By the homomorphism g we can regard the 
vector spaces W and V, which were originally GL{k, C) modules, as x ?7(1)^ modules. 
Through the matrix / the action of the maximal torus f/(l)^ on W is translated into 
a f/(l)^ action on V. It is helpful to keep these points in mind, when we compute the 
equivariant character of the deformation complex. In the following we will identify one 
dimensional x U{1)^ modules with the equivariant parameters of the toric action. 
Namely and Cq, stand for the module where x f/(l)^ acts as the multiplication of 
qi and Cq,, respectively. Hence a product of the equivariant parameters is regarded as 
a tensor product of one dimensional modules. Similarly q^^ and represent the dual 
modules and a sum of monomials in the equivariant parameters represents a direct sum 
of one dimensional modules. 

We can classify the fixed points by generalizing the argument in |23|. The outcome 
is that they are labeled by A^-tuples of plane partitions vf (three dimensional Young 
diagrams), which we call colored plane partition in this paper. To be more precise, in 
non abelian case > 1 we have to assume that the vacuum expectation values Oq, are 
distinct each other. This means that the theory is in the Coulomb phase where the U{N) 
gauge symmetry is completely broken. Let us take a basis {wa} of W such that f/(l)^ 
acts by the multiplication of = e~*'*° on Wa- This is possible, since we have assumed 
that aa 7^ a/3 for a (3. Then we can show that 

V = ©;LiV;, := C[5i, 52, Bs] ■ I{wa) , (3.4) 
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where we allow that Va = {0} for some a. Since V = Vi + V2 + ■ ■ ■ + Vat by the 
stability condition, it is enough to show that fl Vg = {0}, if a 7^ /?. Let f G Vq, fl V3 
and gx := g{l,X). Then we can write v = Bi^ ■ ■ ■ Bi^J{wa) = Bj^ - ■ ■ Bj^I^wp) and 
by (13.1 p with qi = 1 and 03.31) . we have both g^v = Bi^ ■ ■ ■ Bi^g\I{wa) = e~^v and 
gxv = Bj^ ■ ■ ■ Bj^^^gxl{wp) = e^^v. Hence v = 0, since Cq, 7^ e^. By the vanishing theorem 
the condition (13.21) is empty. To see the consequence of the remaining condition (13. ip . 
we consider the decomposition Va = ®i,j,k&yaii — ^, j — ^, k — 1), where the eigenspace 
oi gq ■■= giQiA) is 



Then by the conditions of the fixed points, it is easy to see that I{wa) G Vq(0,0,0) 



and that Bi{Va{i, j, k)) C V^ii - 1, j, k), B2{Va{i, j, k)) C Va{i, j - I, k), B3{Va{i, j, k)) C 



Va{i,j, k — 1). Furthermore, as was shown in [TB] : 

1. V{i,j, k) = {0}, if one of i,j, k is non-positive. 

2. dimV{i, j, k) = 0, or 1. 

3. diml^(z, j, k) > dim\^(z + 1, j, k) and similar inequalities for j and k. 

For proofs of these facts, we refer to |18j. It is obvious that we can associate a plane 
partition vTq, to the above decomposition data of V^. Conversely, from an A^-tuple of plane 
partitions (vti, it2, - ■ ■ t^n), one can construct a homomorphism g : T^x U{1)^ GL{k, C) 
that solves the conditions (13. ip and (13.30 . Thus the fixed points of the toric action are 
isolated and they are labeled by colored plane partitions. 

We can identify the plane partition vr with the set k) ^N'^ \ k < h{i,j)}, where 

the height function h{i,j) G Z>o satisfies h{i,j) > h{i + l,j), h{i,j) > h{i,j + l). The size 
of the plane partition is defined by the volume of the corresponding set |7r| := j) ^{h j)- 
The size of the colored plane partition vr = (vri, 712, ■■ ■ , ttn) is defined by |7r| := Yl!l=i l^^l- 
By the localization theorem the partition function of our quiver matrix model is expressed 
summation over colored plane partitions; 



where A is the parameter of instanton expansion. As we will see shortly, the size of the 
colored plane partition |7r| is identified with the instanton number k. The weight or the 



i-l,j-l,k-l) = {veV^\ggV = q\-'ql 'ql-^'v} . 



(3.5) 




(3.6) 
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measure Njf{qi, e^) at a fixed point vf is a rational function of the equivariant parameters 
Cq, and qi. It physically represents the quantum fluctuation around each fixed point. To 
compute it at tt we decompose V and W SlsT^ x f/(l)^ module as follows; 



N N 



= 5^ e-\ V, = Y,e-'\ E <l\-'q2-'ql-' ■ (3.7) 

«=1 a=l \{i,j,k)ena ) 

The dual modules are 

N ^ ( \ 

w^.* = E^- ^^ = E^" E ^r'^r^s^M • (3-8) 

a=\ a=l \(jj,A:)G7r<:, y 

These are direct sum decompositions of V and at vr into one dimensional x f/(l)^ 
modules or the characters of x f/(l)^. Note that dim^ = as it should be. 
Since dime ^ = fc, we should have |7r| = k. From the toric action (13. II) - (13. 3p we see the 
equivariant version of the deformation complex at vf is 

Hom (V^, V^) ® Q 

® Hom {V^, V^) ® A^Q 

Hom {V^, V^) ^ Hom {V^, V^) ® A^Q ^ © , (3.9) 

© Hom (\4f, W^) © A^Q 

Hom {W^,V^) 

where Q = qi + q2 + (l2- Hence, the character of the deformation complex is 

X^ = V* ®V®{Q + A'^Q) +W* ®V -V* ®V®{1 + A^Q) -W®V*®A'^Q 
= W* (^V -W V*{qiq2q3) -V^ V*{1 - gi)(l - q2){l - qs) • (3.10) 

That is 

N f ?, \ 



ATT / 



{r,s,t)£'iva 



1 (i,i,fc)G7r^ {r,S,t)£lTa {r,s,t)£TTa £=1 . 



(3.11) 

We first note that in the character Xn the number of the terms with positive coefficient 
and those with negative coefficient coincide if we take the multiplicity into account. This 
is due to the fact that the formal dimension of the moduli space vanish and hence the 
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character should vanish if we substitute = Cq = 1. Therefore we can write the character 



m 



as 

m 

X.Kg.,e„) = J]e-^^"'- J]e-^^ , (3.12) 
i=i 1=1 

where e^^^ ' are monomials in qf and e^. By the symmetry XniQij^a) = ~<li<l2<i3X-n{(ii^',^a^)) 
we can set e"'»* ' = qiq2<la.^~^'^'' ■ Hence if e^'^^'' = e*"-^ ' with i j then e'"-'' ' = e'^^ \ 
But e"'*'^' 7^ e""** ' in general, because if e^^''^^ = e'^i ' then e"'^^'' = y/qiq2C[3- We will also 
show in Appendix B that e"'» ' 7^ {liQiQz)^ (n E Z,). Then, according to the localization 



theorem the weight function is given by 



sinhw,. 



sinhw) 

Compared with the computation in [18], the weight f l3.13p computes the so-called K 
theoretic version of the partition function. For the ADHM matrix model the K theoretic 
version of Nekrasov's partition function corresponds to a five dimensional lift, where the 
relation to topological string amplitudes becomes more transparent [H [351 EH [371 EH] • 
When we impose the Calabi-Yau condition q := ^qiq2qz = 1, the character reduces 

to 

^^ = W* ®V -W ®V* + V ® V\qi + q2 + q-i- gf' - q2^ " ^3"') • (3.14) 

Since W*{ea) = W{e~^) and V*{qi^ea) = V{ql^^e~^)^ we see that under qi — > q^^^Ca — > 
e~^, the sign of the character changes x?? —X^- Therefore we can put w-"'' = —w\^^ 
and hence 

^M.^c) = i-ir ■ (3.15) 

Though the integer m may change, even if N and k are fixed, the parity of m and Nk 
agrees; (—1)™ = (— l)^'^. Hence, the partition function is 

AT 

443^(g.,ea;A) = 5^Al-1(-l)^l-^l = HE^''^"' = ^H"" ' (3-16) 

TT a = l TTa 

where u := (— 1)^A and M{u) is the MacMahon function. This result was already 



obtained in [18] . Note that the argument of the MacMahon function is not the equivariant 
parameters of the toric action but the parameter of instanton expansioij^. The fact that 



''However, according to [53] it is possible to regard the parameter A as a part of fl background of 11 
dimensional supergravity, or M theory. 
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the weight of each fixed point is ±1 reminds us of the topologically twisted A/" = 4 super 
Yang-Mills theory in four dimensions [39] . 



4 Computations in non Calabi-Yau case 

In the last section we have seen that the partition function reduces to a power of the 
MacMahon function if we impose the Calabi-Yau condition. In particular, it is completely 
independent of both and Cq,. This is a remarkable difference from Nekrasov's partition 
function ^Nek- When we impose the self-duality condition ei + €2 = 0, ^Nek is a function 
of q := e'^' = qi = q^^ and a^. The leading term of the genus expansion by gives the 
Seiberg-Witten prepotential and the full expansion is identified with topological string 
amplitudes. For generic equivariant parameters qi and it is expected that Nekrasov's 
partition function gives a certain refinement of topological string amplitudes [iO l [T2l [15] . 
Thus it is interesting to see what happens to our instanton partition function, if we do 
not impose the Calabi-Yau condition. 

For non Calabi-Yau case the weight function N^{qi, Ca) no longer takes a simple form 
and is a rather complicated function. To obtain an idea on the structure of the partition 
function we made some explicit computations for lower rank and lower instanton number 
and found that the partition function is independent of Cq. In the following by examining 
the residues we will confirm this up to three instanton number for general A^. Based on 
these explicit computations of several examples, we strongly believe that this property 
holds for higher instanton numbers and conjecture that the full partition function is given 

by 



yU{N) 
^6D 



where 



E^^^(^^^2,g?;A")) , (4.1) 

\n=l 



i^o(gi,g2,g3) , (4.2) 



(1 - A)(l -q2^A) 
and A = (— q)~^A. For later convenience we have introduced 

^0[qi,q2,q3) ■- 7Z TT- TT- T • (4.3) 

(l-gi)(l-g2)(l-g3) 
For U{1) theory the same conjecture was already given by Nekrasov p4] and the above 
proposal is a generalization to U{N) theory. It may look that there is only a little 
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difference between U{N) and U{1) theories. However, we would like to emphasize that 
it is a consequence of the crucial fact that the partition function does not depend on the 
equivariant parameters from the maximal torus f/(l)^, or the vacuum expectation values 
of Higgs scalars. If we impose the Calabi-Yau condition q = 1, our conjecture implies 

Nu 



[i-uy 



(4.4) 



with A = (-l)^A = u. Thus we recover the result of the last section. In this sense 
the above instanton partition function suggests a generalization of Donaldson-Thomas 
theory to Kahler manifold. 

Let us consider the following instanton expansion 



k=l 
oo 



(4.5) 
(4.6) 



k=l 

It is quite amusing that since 

_ A(l + q2 + q4 + ... + q2^-2) _ _1 

(l-A)(l-q2^A) ~ l-q2 Vl-A l-q2^A 

the coefficients of the instanton expansion of take a very simple form; 

Fi^\qi, q2, gs) = -q'^'-'lNk]^ ■ Fo(gi, q2, qs) , 
where the q-integer is defined by 

l-n, q 



^ k=i ^ 



\n 



q — q 



q-q 



q 



(4.7) 



(4.8) 



(4.9) 



l-q2 

We have the q-binomial theorem ([41j; Chap. 1-2, Example 3), which is useful in the fol- 
lowing computation, 

N N 



n>0 



n 



7V+1-2q\ 



0=1 



E 

fc=0 



N 
k 



(4.10) 



with 



N' 
k 



[N-kUk]\^' 



[N]\^:=[NUN-1]^...[1U. (4.11) 
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Prom this we obtain 



and 



q 



k{N+l) 



E no 



2ai 



<N 


i=l 




'N' 


2 


'N' 




-2 




1 


q 


_ 2 _ 



TV 
k 



'N' 


3 

-3 


'N' 




'N' 


+ 3 


'N' 


1 


q 


1 


q 


2 


q 


3 



(4.12) 

(4.13) 
(4.14) 



In terms of the instanton expansion of the partition function is 

zS\qi,q2,q3)^F^^\q^,q2,qs) + ^[F^^\q,,q2,q3)y + ^Fii\qlqlql) , (4.15) 

Z^iqi, q2, qs) = Fj^\qi, q2, qs) + F^^\qi, gs, g3)^^^(gi, ^2, qs) 

+ lF^N\ql ql ql)F^N\qu ^2, gs) + ql ql) + 1 ?2, ga))' . 

In the following subsections we prove the conjecture up to three instanton number for 
any N. 



4.1 One instanton 

The fixed points with k — 1 are the colored plane partition (□,•,••• , •) and its cyclic 
permutations, where □ stands for the plane partition with unit volume. The character 
of the fixed point tt (a) with V^^^^ — is 



and 



X7f(a) = XI ~ + + q2 + q3- qiq2 - q2q3 - qsqi) 

AT (n .\ ^-jv (l - gig2)(l - g2g3)(l - gagi) T-T eg - q^e^j 

TV^f («)(*, ca) = q — jz ^ — M 

(l-gi)(l-g2)(l-g3) ^4 

We can show that 

N o 

e/3 - eg 



En 



-ir-'a + q' + q' + '-' + q™ ■ 



a=l /37^a 

In fact possible poles in the left hand side are at eg = C/j. But we see that 



(4.16) 



(4.17) 



(4.18) 



ReSe„=e^iV7f(g) = -ReSe„=e5iV7f(/3) • 



(4.19) 



15 



Hence all the residues vanish and the left hand side is a constant in Cq,. We may compute 
it by putting e„ = (1 < a < A^) and taking the limit L — oo to obtain fl4.18p . 

Thus we find that Z^^ does not depend on e^, which physically means it is independent 
of tta, or the relative distances of D6 branes. The partition function at one instanton 
is 

N 

= E ^-1") = (-q)"'(-l)'^[A^]q ■ ^o(gi, q2, qs) , (4.20) 

a=l 

which proves the conjecture at one instanton. 



4.2 Two instanton 

Two instanton part of the partition function is computed as follows; we have two types 
of configuration, whose characters are V^*^ := 6^(1 + ^j), 1 < a < A^, z = 1, 2, 3, which 
we call type I in the following and V^^^ ^) := + e^j, 1 < a < /3 < A^, which we call type 
II. 

For type I we find 

N^{a,i){(l^, ex) = q nl '{qe) [[ — _ — — , (4.21) 



where 



Similarly for the second type we have 

AT (n .\ ^ ^l<^<,<3(e^ " (im)^^^^ ' (^aHQj) yT (c^ - c^q') (c^ - C/^q^) 

nti(ea-e/3g.)(e^-e,g,) ^^^^ (e^ - e^)(e^ - e^) 

(4.23) 

where 

nu{qi) := Fo{qi,q2,q3f ■ (4.24) 

Let us look at possible poles and residues there. There are poles at = and 
qiCa = 6/3. Taking the relation q^ = qiq2q3 into account, we see the relations 

ReSe„=e^ {N^(a,i) + N^{t3,i)) =0, « = 1, 2, 3, 

ReSe^=e,{N^ia,-y) + N^{f3rf))=^^ 1 < 7 < ^, 7 7^",/?, (4.25) 

ReSg.e„=e^ {N^{a,i) + ^7f(a,/3)) =0. 
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Therefore, the partition function does not depend on Cq. By estimating the leading terms 
Cq, = L~", L — s> oo, we find the two instanton part of the partition function is 

(N 3 
a=l i=l l<a<l3<N 

. /•> /V 

nuiQi) 1 . (4.26) 

q 



'N' 
2 



\ i=i 
On the other hand the conjecture says 

Using the identity fl4.13p we can see that the conjecture at two instanton reduces to the 
following identity; 

[N]^2 ■ Fo(gi, q2, qs) ■ Guii){qi, ^2, ga) = , (4.28) 
where G(7(i) = is equivalent to the identity 

= _(i + q2) _ + gig2)(i + g2g3)(i + qsqi) _^ 1 ^ ?ig2)(i - g2g3)(i - qsqi) 



2 (i + gi)(l + g2)(l + g3) 2 (i-gi)(l-g2)(l-g3) 

(4.29) 

The crucial point is that dependence is factored out and the remaining factor Gu(^i) 
is universal in the sense that it is independent of the rank A^. That is what we have to 
prove for general is the same as that for U{1) case. Actually the identity (14.291) is 
necessary for proving the conjecture for U{1) theory. In this case type II configuration 
does not appear and the proof of the conjecture is easier. We note that the identity 
fl4.29p is transformed into the following form 

if J9 = qiq2qz- Hence one can derive (14.290 from the partial fraction decomposition 

n n 71—1 

p^-X, ^ y p-X^ yr pX^-X^ _ y 

l=\ * i=l * * ^ i=l 
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with n — 3 and Xi — ±zqi. 

The fact that the proof is essentially reduced to abelian case might be expected. We 
know that the result is independent of the vacuum expectation values of Higgs fields 
by looking at residues. This means the partition function does not depend on relative 
distances of D6 branes and hence we can compute it by taking the decoupling limit 
where D6 branes are infinitely separated. In fact the leading term mentioned above can 
be regarded as the result in this limit. 



4.3 Three instanton 

We have four types of configurations; 

1. Type Ai V.\^.^ = e,(l + + gf), 1 < a < N, i = 1,2,3 

where 

(4.33) 

2. TypeA2 ^^V,,,,) = e„(l + + g,), l<a<N, l<i<j<3 

N,^.,.,M e.) - q n,, [[ - e,)(,.e. - e,)(g,e. - e,) ' ^''''^ 

where with k ^ i,j 

(id) r \ ~ ii(ik){'^ - (1 - qhj)i'^ - mj) {q-i - q]qk){qj - qhk) „ . . 

(1 - ?i) (1 - - Qk) {qj - qk) {qi - q]) {qj - qt) 

(4.35) 

3. lypeS y.*^_^.^=e«(l + g,) + e/3, l<a^(5<N, 1,2,3 

I X -37V {i)t N TT (67 - ec,q^)(e^ - ep<^){e^ - g^e^q^) 

[egqi - efj U-^- qj){ep - e^q^)(e^ - Hj^i gj) Uj^jje/s - e^qUj)^^^^ - e^qiq^) 
(ea - ef3){ea - efiqi){eii - Caqf) Hj^iieaqi - ef3qj){ep - e^qj) 

(4.36) 
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X 



where 



[Qe) ■— /-I _ rr — J ^ ^o[Qi^ Q2, qs) — [Qej^oKQi, ?2, Qs) ■ 

U 1i)[Ljjti\Qi Qj) 

(4.37) 

4. lype C IC*^^^^^) ^ea + e^ + e^, 1 < a < /? < 7 < TV 

^ TT (e^ - e^q^)(e^- - epCi^){es - e^q^) 

where 

nc(g^) := -Fo(gi, ^2, gs)^ = ?T'ii(%)-^o(gi, ^2, Qa) ■ (4.39) 
As before all residues cancel out between two terms as follows; 

ea=e/3 (-^7r(a,ij) "I" -^7f(^,iJ)) — 0, ReSg.e;^=e^ ( 

ReSe„=e^ ( 

with 7 7^ a, /3 and j i. Thus we can confirm that the partition function does not depend 
on Ca and compute the partition function by taking the decoupling hmit as before. The 
three instanton part of the partition function is 

(N 3 N 

Y: q^"-^ E < (*) + E q'""' E (*) 
a=l i=l a=l (ij) 

+ E q'°^''"'E4^(?^)+ E q'"^''^'^-' • ^c(g.) 

'i-<oi¥=l3<N i=l l<a</3<7<iV 

= q-^(-i)^-^ ( [Nu^ E ^2 (*) + 1^]'.^ E (*) 

3 



0, 




0, 




0, 


^^^qiea=ep ( 


0, 





+ ([^]q^[^]q-[^]q3)E^s(^^) + 



N 
3 



q 



(4.41) 
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The conjecture implies 



ZP = (-(1 + q' + q')[iV]q3 ■ Fo(gi, q^, gs) + (1 + q')[iV]q2 ■ Mqi, q2, qzf 
- 3[^]''^ (l + g, + g?)(l + g. + gi)(l + g3 + g|) 

-i[iV]3Fo(gi,g2,g3)') • (4.42) 

Using f l4.14p and (14.291) which we have used at two instanton, we see that the conjec- 
ture boils down to 

[Ar]q. ■ Fo(gi, g2, gs) ■ Huii){qi, g2, gs) = , (4.43) 
where if[/(i)(gi, g2, gs) = is equivalent to the identity 

P-Qi TT ~ 9i , ~ ^fc P^j ~^kT-r PQi - Qj PQj " % 



TT P^ 'ii TT ^"/i ~ "/j I \ ^ P^i - pqj - qk tt 

= p\l+p + p^)+ p(l + p)/(p, g,) + !/(/, g2) + + 1 /(p, g,)2 , (4.44) 

2 3 /(p,g£) 3! 

with f{p,qe) '■= Y['e=i (P ~ ^i) / ii p = gig2g3. Again we can factor out de- 

pendence completely and what we have to show is the identity (14.441) . which is required 
for proving the conjecture for f/(l) theory. Note that in U{1) case the colored plane 
partitions of type B and C do not appear. We can check the identity (14.441) by direct 
computation based on the partial fraction decomposition. 

In summary, computations of instanton number two and three show that basic ingre- 
dients for the validity of the conjecture are identities for q-integers such as (14.131) and 
fl4.14p and the combinatorial identity for f/(l) theory like (I4.29P and fl4.44p . We believe 
we will see similar structure for higher instanton numbers. In fact (14.131) and (14.140 are 
the first two identities which are derived form the q-binomial theorem (I4.10p . On the 
other hand at the moment we cannot see any underlying reason for the identities (14.290 
and (14.440 . though we can check them by considering the partial fraction decomposition. 
Since they are the equalities for U{1) theory, it is tempting to expect that they are related 
to the geometry or combinatorics of the Hilbert scheme Hilb'^(C'^) of points in C^. 
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Appendix A : ADHM matrix model and Nekrasov's 
partition function 

In this appendix we review how we can derive Nekrasov's instanton partition function 
as an equivariant index of the matrix quantum mechanics of the ADHM equations. Let 
us consider two vector spaces V and W with complex dimensions, dime V = k and 
dime W = N. In the language of D brane system we have k DO branes bound to 
D4 branes. As an effective theory on DA branes we have U{N) gauge theory and k DO 
branes describe the gas of point-like k instantons. In the D brane picture the ADHM 
construction is a dual description where we consider an effective 0-1-1 dimensional theory 
on DO brane [IHl |20l [2ll |22] . We have 5i,2 G Hom {V,V) from "0-0" string. From "0-4" 
and "4-0" string we have / e Hom {W, V) and J G Hom (V, W). The ADHM equations 
for these ADHM data are 



When we construct the moduli space of instantons as the hyperKahler quotient, they 
play the role of hyperKahler moment maps. Namely the moduli space can be identified 
with 



[B^,B2]+IJ = 0, 

Bl] + [B2, Bl] + J/t - Jt J - C = . 



(A.l) 
(A.2) 



-A^ADHM := {{Bl, B2, I, 



J)\Sc = 0,£^{O = 0}/U{k) . 



(A.3) 
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The formal dimension of A^adhm is computed as follows; we impose 2k'^ + k'^ (real) 
constraints on 4A;^ + 4NK (real) degrees of freedom from the matrices {Bi, B2, 1 , J). 
Since the gauge group U{k) reduces further fc^ degrees of freedom, we find the moduli 
space has 4NK dimensions, or dim^TVlADHM = ^Nk, which agrees to the dimensions 
of the moduli space of ASD instanton of U{N) theory with instanton number k. It 
is known that the moduli space is isomorphic to the following affine algebro-geometric 
quotient [221 E] ; 

-Madhm := {(5i,52,/, J)| Sc = 0}//GL{k,C) • (A.4) 

In (IA.4p instead of the D term condition we impose the algebraic stability condition that 
there is no proper subspace S" of which satisfies BiS C S, B2S C S and Im (/) C S. 

We consider the toric action {zi,Z2) (e*^^2;i, e*^^Z2) of on C^. The ADHM data 
transform {Bi, B2, 1, J) {qi ■ Bi, q2 ■ B2, 1, (q'iq'2) ■ J) where Qi := e**"'. The fixed points 
are isolated and classified by A^-tuples of partitions A ^23J . The equivariant deformation 
complex at a fixed point A is [23| [3lli2| H3l Hi] : 

Hom {V^^,V^)(»Q 

}iom{V-^,V^) ^ Hom(l^^,V3^) ^ Rom {V^^,V^) ^ A'Q , (A.5) 

© 

Hom {V^, W£) © A^g 

where Q = T^^ + T2^ and Tj is one dimensional module on which acts as the multi- 
plication of e**^'. Hence the equivariant index is 

^ = (^V*(^V)Q + W*^V + V*®W^A^Q- {V* © \/)(l + A^Q) 
= W* ®V + V* ® W{TiT2y^ - V* © V{1 - Tf ^)(1 - Ts"^) . (A.6) 

We have 2NK positive terms in this index which are regarded as the weights (eigenvalues) 
of the toric action at the fixed pointcl- Each weight is a monomial in the equivariant 
parameters qf = e^"^' from and = e^*"" . Hence from a character of the form x = 
Si=L^ 6xp(wj), we obtain the following contribution to the instanton partition function; 

2Nk 

z{X) = - expiw,))-' , (A.7) 

i=l 



^In the character (|A.6p all the term with negative coefficient are canceled and there are 2Nk remaining 
terms. 
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where we consider the K theoretic version of the partition function, which corresponds 
to the index of the Dolbeault operator d or the Todd class. By locahzation theorem the 
partition function is computed by summing up all the contributions at each fixed point, 
or the colored partition A; 

ZNek(ea,gi;A) = 5^ -= -iv rp- (A.8) 



where 



iV.,.(e«,gO= n n (l-^?^"'^^r^''"e«e-) . (A.9) 

Note that we have renormalized the parameter A of instanton expansion by y/qiq2 as we 
made for the topological partition function in this paper. 



Appendix B : Well-definedness of Njf{qi, e^) 



„{+)- 



To define the weight function N^{qi, 6^), {e*"' }, which is defined by (13.121) . should not 
contain 1. We prove it here. 

A plane partition vr is define as a finite set of positive integers, n = k)} C N^, 

such that if {ij, k) e ir then k') E ir {1 < i' < i, 1 < j' < j, 1 < k' < k). Given 

any plane partition vr, let 



n{s;t) := i^{{i,j,k) G vr | {i',j',k') := (i - Si - ti,j - S2 - t2, k - S3 - t-^) E n} 



(B.l) 



with s = (si, S2, S3), t = {ti, t2, ts) and 



no{s) 
ni(s) 
^2(5) 



:n(s; 0,0,0), ri_i(s) := # {(si + 1, S2 + 1, S3 + 1) En} 
n{s; 1,0,0) +n(s;0, 1, 0) + n(s; 0, 0, 1), 
0, 1, 1) + 1, 0, 1) + n(s; 1, 1, 0), 
n{s; 1, 1, 1). 



(B.2) 



Note that 



no(0,0,0) = |7r|, n_i(0,0,0) 



0, 
1, 



vr = 



(B.3) 
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First we have 

Lemma. If {si, S2, S3) G Z>q then X]£=-i(~l)^^^('^) — 0- 

Proof. For vr = 0, since n£{s) = 0, the lemma holds. Assuming the lemma to hold for 
vr, we will prove it for the plane partition vr' = vr U {{i,j,k)}. The differences between 
n£(s)'s of TT and those of tt', (Z\?7,_i(s), Z\?t,o(s), Z\ni(s), Zin2(s), Z\n3(s)), are 

(0,1,3,3,1), i - si,j - S2,k - S3 > 1, 

(0,1,2,1,0), {i - si,j - S2,k - S3} = {l,a,/3}, 

(0, 1, 1, 0, 0), {z - s^,J -S2,k- S3} = {1, 1, a}, (B.4) 

(1,1,0,0,0), i - Si = j - S2 = k - S3 = 1, 

(0,0,0,0,0), i — si or j — S2 or A; — S3 < 1, 

with > 1. Thus it holds for it'. q 

For e'^' ' introduced in ( ]3.12p and ( ]3.13p . we have 
Proposition, e^i^^ ^ q^lTlT ^^^^ (^i,'^2,^3) ^ Z<o or G N^. 
Proof. It suffices to show it when = 1, i.e., for 

- E ^-'^-'^t' f 1 - E + E ^ - ^^^^^3) . (B.5) 

Each monomial qiq\q3 in the 1st, 3rd, 4th, 5th and 6th terms of (IB.SP becomes qi^^q2^^q3^^ 
{si G Z>o) if and only if (i, j, /c) = (si + 1, S2 + 1, S3 + 1), (i, j, /c) - {i',j',k') = (51,52,53), 

(z, J, A;) -(^',/, A;') -(51, 52, 53) = (1,0,0) or (0,1,0) or (0,0,1), 
(^,j,A;)-(^',/,A;')-(si,52,53) = (0,l,l) or (1,0,1) or (1,1,0), 
it,J, k) - k') - (51, 52, 53) = (1, 1, 1), (B.6) 

respectively. But the number of them are ?t,_i(5), uq^s), ^1(5), ^2(5) and ^3(5), respec- 
tively, whose alternating summation vanishes. Thus e""*' ' 7^ qi^q^qs^ with (ni,n2,n3) G 
Z|o. The symmetry X7f(gi,ea) = -glg2g3X7f(C^ e^^) guarantees that e'"**^ ^ qTqTqT 
with (ni,n2,n3) G N^. □ 
Therefore, N^^qi^Ca) is well-defined. 
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